Python Job: Data Engineering Lead

Data Engineering Lead- Bank of Ireland - Republic of Ireland/United Kingdom

#li-hybrid #ij-hybrid

Bank of Ireland Group is an equal opportunities employer and is committed to fostering an inclusive workplace which values and benefits from the diversity of our workforce.

Bank of Ireland are delighted to be hiring a Data Engineering Lead to join our Data Factory team!

You will work in a team of like-minded professionals with a broad range of experience and backgrounds across IT and the Business. You will help craft, guide, and establish the ways of working, participate in exciting new technology initiatives and develop strategic capabilities to enable the bank to develop and maintain this strategic asset.

The Engineering function offers great prospects for career progression within the Bank along with opportunities to build and grow highly sought-after technical skills and capabilities!

Who are we?

Our growing and exciting Data Factory team provides the engineering services for the Group's Enterprise Data Warehouse and Enterprise Data Lake. We deliver the data element to support Digital, Customer, Regulatory and other change initiatives that drive the Group's transformation agenda. We have fully embraced new ways of working such as scaled agile, DevOps and design thinking in a highly collaborative team environment.

What is the opportunity?

As Data Lake Engineering Lead will ensure that technical development processes, standards, governance and tooling are appropriate and effective for the Enterprise Data Lake, and that the quality of the solutions delivered into operational support are fit for purpose.

You will be responsible for the technical leadership and mentoring of engineering squads, ensuring that incoming change is 'engineering ready'.

As a People Manager you will drive engagement, and will be accountable for demonstrating and role modelling the Group values and behaviours through your people management and the way in which you deliver business goals.

Key Accountabilities

• Providing technical direction and leadership to engineering squads
• Inputting to the process to assess whether incoming change is 'engineering ready' and works with business and IT colleagues to establish and manage entry requirements
• Experience with modern data engineering practices including

• Code Management Practices and Processes

• Automation

• Tooling

• T-Shaped Skills with sufficient breadth of knowledge across infra, app and data

• Resource Management

• Managing development resources

• Managing partner / vendor resources

• How to measure performance of individuals and squads

• Defining the technical capabilities and resource profiles required within the squads
• Work with internal resource management and external delivery partners to ensure the right capability is in place within the teams
• Software vendor management experience
• Experience with processing large datasets as well as streaming data and unstructured data sources, including HBase, Kafka and Spark
• Strong ETL and data pipeline experience particularly with modern big data toolsets such as Airflow and Nifi or equivalent
• Strong programming background in either Python or Scala
• Experience in modern engineering practices and technologies
• Good working knowledge of data architecture principles
• Continuous improvement and innovative mind-set
• Financial services experience would be advantageous
• Engineering standards methodology adoption within the squads
• Ensuring engineering squads have the requisite tooling, methodology and process to drive delivery efficiency
• Identifying, developing proposals and managing the execution of initiatives to automate, simplify and scale services
• Being a leader for other specialists and ensures that career path and data sharing is embedded in ways of working
• Aspiring to continuously develop new and improved data engineering capabilities
• Contributing to the continual improvement of the business's data platforms through observations and well-researched knowledge
• Continuously keeping track of industry standard methodologies and trends and through acquired knowledge, which takes advantage of process and system improvement opportunities

Who are you?

Essential Qualifications

• BSc or MSc in Engineering & Computer Science, Applied Mathematics, or Data Engineering.

Essential Skills & Experience

• Proven experience as Engineering Lead in the Data Lake domain
• Stakeholder Management
• Deep technical knowledge of Data Lake and Cloud Technologies and Architecture preferably AWS
• Experience and Proficiency in Python, Scala, Spark, PySpark
• Demonstrable experience and a deep knowledge of NoSQL Databases
• Experience in Management & Co-ordination, Security, Data Storage and Integration tooling and Frameworks for Data Lakes e.g. Oozie, Spark, Hive, Impala, Hbase, Kafka, NiFi
• Experience and Proficiency in Rest APIs
• Familiarity with Data Streaming, relevant use cases and appropriate processing frameworks
• Large scale delivery experience and data management experience
• Scrum / Kanban and SAFe delivery experience

Location

Working at Bank of Ireland doesn't have to mean working in an office to have an impact. Our commitment to enabling colleagues to thrive means that depending on role type you can have choice and flexibility in where you work and live, subject to your role, customer needs and our requirements. We have a hybrid working model, with home, agile hub and office based options available. We will always list a primary location which can be where you go for in person collaboration, and a location where you can best perform your role.

This job can be done anywhere in the Republic of Ireland / Northern Ireland/ United Kingdom with the primary office location as Dublin or Bristol to which travel will be required for in person collaboration.

Exact frequency to be agreed with manager. Please note you must live in the jurisdiction for the business to which you are contracted.